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(54) Stereoscopic image display apparatus 

(57) A stereoscopic image display apparatus is con- 
structed to guide a parallax image displayed on a dis- 
play, to the left eye and to the right eye of an observer, 
thereby permitting the observer to stereoscopically ob- 
serve the image information displayed on the display. 
The stereoscopic image display apparatus has a view- 
point position detecting device for detecting positions of 
view points of the observer, an image display device for 
displaying the parallax image, a light source device in 
which a position of each light emitting portion is control- 
led based on information from the view-point position 
detecting device, an optical system for imaging each 
light emitting portion of the light source device at or near 
an observation position, and a separating device for 
separating light from the light source device to guide 
separated beams to the two eyes of the observer. 



FIG. 1 




a. 

m 



Printed by Jouve. 75001 PARIS (FR) 



BNSDOCID: <EP„ _ 1102106A2 I > 



1 



EP 1 102 106 A2 



2 



D scription 

BACKGROUND OF THE INVENTION 
Field of the invention 

[0001 ] The present invention relates to a stereoscopic 
image display apparatus and, more particularly, to the 
stereoscopic image display apparatus that has an im- 
age display section and is constructed to display a ster- 
eoscopic image (parallax image) on the image display 
section so as to permit observation of the stereoscopic 
image and that is suitably applicable to satisfactory ster- 
eoscopic presentation of image information in a display 
device for television, video, and computer monitors, 
game machines, and so on. Related Background Art 
[0002] As one of the conventional stereoscopic image 
observation methods, there is a method in which the 
parallax images for the right eye and for the left eye are 
provided with states of polarization different from each 
other and are guided through polarizing spectacles to- 
ward the left eye and toward the right eye to be sepa- 
rated from each other, thereby permitting observation of 
a stereoscopic imago. 

[0003] In this method, a liquid crystal shutter is dis- 
posed on the display side in order to make the different 
states of polarization, the polarization states are 
switched one from another in synchronism with field sig- 
nals of display image on the display, and the observer 
with the polarizing spectacles observes the left and right 
parallax images separated in time-sharing manner, one 
by one by the respective eyes, thereby being allowed to 
experience stereoscopic vision. 

[0004] This stereoscopic vision observation method 
making use of polarization required the observer to al- 
ways wear the polarizing spectacles and thus had such 
a drawback that it was troublesome. 
[0005] As another stereoscopic image display meth- 
od of permitting observation of the stereoscopic image 
without use of the polarizing spectacles, different from 
the above method, there is a lenticular lens method in 
which a lenticular lens is disposed in front of the display 
to spatially separate the parallax images toward the left 
and right eyes of an observer 

[0006] Since the lenticular lens was placed in front of 
the display for displaying the image, this method had 
such drawbacks that the quality of image was degraded 
by surface reflection from the lens surface or the like 
and that the black matrix of the liquid crystal display ap- 
peared as moire fringes to obstruct the view. 
[0007] As against it, the inventors filed Japanese Pat- 
ent Application Laid-Open No. 9-311 294, which disclos- 
s the stereoscopic image display apparatus having a 
wide observation field and permitting good observation 
of the stereoscopic image, using a method in which two 
lenticular lenses are placed behind the image display to 
separate the images toward the observer's left and right 
eyes. 



[0008] Further, the inventors also filed Japanese Pat- 
ent Application Laid-Open No. 10-078563 to suggest 
the improvement in the above apparatus. The applica- 
tion Laid-Open No. 10-078563 discloses the stereo- 
5 scopic image display apparatus, as illustrated in Fig. 20 : 
in which the stereoscopic vision area is moved left and 
right and back and forth to follow movement of the ob- 
server 7, based on information obtained by view-point 
position detector6 for detecting the observation position 
10 of the observer 7. 

[0009] In Fig. 20, numeral 1 designates a backlight 
source, 2 an optical modulator for displaying a mask pat- 
tern, 3 a lateral lenticular lens ; 4 a vertical lenticular lens, 
5 the display device for display of image, and 6 the view- 
's point position detector. 

SUMMARY OF THE INVENTION 

[0010] An object of the present invention is to present 
20 further improvement in the stereoscopic image display 
apparatus proposed before by the inventors and provide 
the stereoscopic image display apparatus that permits 
observation of the stereoscopic image with good image 
quality. 

25 [0011] Another object of the present invention is to 
provide the stereoscopic image display apparatus that 
permits a plurality of observers to observe the stereo- 
scopic image simultaneously with good image quality. 
[0012] A stereoscopic image display apparatus ac- 
30 cording to one aspect of the present invention is a ster- 
eoscopic image display apparatus comprising light 
source means in which positions of a plurality of light 
emitting portions are controllable; image display means 
which displays a stripe image obtained by dividing par- 
35 allax images into a lot of stripe pixels and arranging the 
stripe pixels in a predetermined order to form one image; 
separating means which converts beams from the light 
source means into beams with directivity and which sep- 
arates beams from the image display means into beams 
40 toward a plurality of areas and guides the separated 
beams to an observer so as to permit the observer to 
visually recognize the stripe image as a stereoscopic im- 
age; optical means for forming an image of each light 
emitting portion of the light source means at or near an 
45 observation position through the separating means and 
the image display means; and view-point position de- 
tecting means for detecting positions of view points of 
the observer, wherein said light source means controls 
the number and positions of light emitting portions, 
so based on a signal from the view-point position detecting 
means. 

[0013] In a further aspect of the present invention, 
said separating means is comprised of an optical mod- 
ulator having a discrete pixel structure, or comprised of 
55 an optical modulator having a discrete pixel structure 
and an optical system. 

[0014] In a further aspect of the present invention, 
said optical system comprises a vertical cylindrical lens 
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array consisting of vertical cylindrical lenses having a 
generating line in the vertical direction and a horizontal 
cylindrical lens array consisting of horizontal cylindrical 
lenses having a generating line in the horizontal direc- 
tion. 5 
[0015] In a further aspect of the present invention, 
said view-point position detecting means comprises in- 
frared light emitting means and detects positions of pu- 
pils of the eyes of the observer. 

[0016] In a further aspect of the present invention, 10 
said image display means is comprised of a transmis- 
sive image display device having a discrete pixel struc- 
ture. 

[0017] In a further aspect of the present invention, 
said light source means is a surface emission type light is 
source having a discrete pixel structure. 
[0018] In a further aspect of the present invention, 
said optical means is a Fresnel lens acting as a convex 
lens, or a Fresnel lens acting as a convex lens only in 
the horizontal direction. 20 
[0019] In a further aspect of the present invention, 
said view-point position detecting means detects posi- 
tions of view points of a plurality of observers independ- 
ently of each other and said light source means controls 
positions of light emitting portions corresponding to the 25 
respective observers, based on a signal from the view- 
point position detecting means. 

[0020] A stereoscopic image display apparatus ac- 
cording to one aspect of the present invention is a ster- 
eoscopic image display apparatus in which beams from 30 
light source means in which a position of a light emitting 
portion is controllable, are converted into beams with di- 
rectivity by separating means to illuminate a parallax im- 
age on image display means displaying stripes of par- 
allax images whereupon beams based on the respec- 35 
tive parallax images are guided separately to the right 
eye and to the left eye of an observer, thereby permitting 
the observer to observe a stereoscopic image, wherein 
an image of the light emitting portion of the light source 
means is formed at or near an observation position *o 
through the separating means and the image display 
means by optical means and wherein the position of the 
light emitting portion of the light source means is con- 
trolled, based on a signal from view-point position de- 
tecting means for detecting positions of view points of *s 
the observer. 

[0021] In a further aspect of the present invention, 
said separating means is comprised of an optical mod- 
ulator having a discrete pixel structure, or comprised of 
an optical modulator having a discrete pixel structure so 
and an optical system. 

[0022] In a further aspect of the present invention, 
said optical system comprises a vertical cylindrical lens 
array consisting of vertical cylindrical lenses having a 
generating line in the vertical direction and a horizontal 55 
cylindrical lens array consisting of horizontal cylindrical 
lenses having a generating line in the horizontal direc- 
tion. 
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[0023] In a further aspect of the present invention, 
said view-point position detecting means comprises in- 
frared light emitting means and detects positions of pu- 
pils of the eyes of the observer. 

[0024] In a further aspect of the present invention, 
said image display means is comprised of a transmis- 
sive image display device having a discrete pixel struc- 
ture. 

[0025] In a further aspect of the present invention, 
said light source means is a surface emission type light 
source having a discrete pixel structure. 
[0026] In a further aspect of the present invention, 
said optical means is a Fresnel lens acting as a convex 
lens, or a Fresnel lens acting as a convex lens only in 
the horizontal direction. 

[0027] A stereoscopic image display apparatus ac- 
cording to one aspect of the present invention is a ster- 
eoscopic image display apparatus comprising light 
source means in which positions of light emitting por- 
tions in a number according to the number of observers 
are controllable; image display means which displays a 
stripe image obtained by dividing a parallax image for 
the right eye and a parallax image for the left eye each 
into a lot of stripe pixels and alternately arranging the 
right stripe pixels and left stripe pixels thus obtained, in 
a predetermined order to form one image; separating 
means which converts beams from the light source 
means into beams with directivity by a lenticular lens ar- 
ray and which separates beams from the image display 
means into beams toward a plurality of areas and guides 
the beams to each observer to permit the observer to 
visually recognize the stripe image as a stereoscopic im- 
age; imaging means for imaging each light emitting por- 
tion of the light source means at or near an observation 
position through the separating means and the image 
display means; and view-point position detecting means 
for detecting positions of view points of each observer, 
wherein said light source means controls the number 
and positions of light emitting portions, based on a signal 
from the view-point position detecting means. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0028] 

Fig. 1 is an overall view of the stereoscopic image 
display apparatus as Embodiment 1 of the present 
invention; 

Fig. 2 is a system block diagram of Embodiment 1 ; 
Fig. 3 is a schematic diagram to show the main part 
of the stereoscopic image display section of Em- 
bodiment 1 ; 

Fig. 4 is an explanatory diagram to illustrate the ac- 
tion of the light source means of Embodiment 1 ; 
Fig. 5 is an xplanatory diagram to illustrate the 
mask pattern of Embodiment 1 ; 
Fig. 6 is an explanatory diagram to illustrate the syn- 
thesis of parallax images in Embodiment 1 ; 
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Fig. 7 is an explanatory diagram to illustrate a pupil 
position detecting camera of Fig. 1 ; 
Fig. 8 is a photographic screen of a visible light cam- 
era of Fig. 7; 

Fig. 9 is a photographic screen of an infrared light 
camera of Fig. 7; 

Fig. 10 is an explanatory diagram to illustrate the 
optical action of Embodiment 1 ; 
Fig. 1 1 is a system block diagram of Embodiment 2; 
Fig. 12 is a schematic diagram to show the main 
part of the stereoscopic image display section of 
Embodiment 2; 

Fig. 13 is an explanatory diagram to illustrate the 

action of the light source means of Embodiment 2; 

Fig. 14 is an explanatory diagram to illustrate the 

mask pattern of Embodiment 2; 

Fig. 15 is an explanatory diagram to illustrate the 

synthesis of parallax images in Embodiment 2; 

Fig. 16 is an explanatory diagram (X-Z section) to 

illustrate the optical action of Embodiment 2; 

Fig. 17 is an explanatory diagram (X-Z section) to 

illustrate the optical action of Embodiment 2; 

Fig. 18 is an explanatory diagram (Y-Z section) to 

illustrate the optical action of Embodiment 2; 

Fig. 19 is an explanatory diagram (Y-Z section) to 

illustrate the optical action of Embodiment 2; and 

Fig. 20 is a schematic diagram to show the main 

part of the conventional stereoscopic image display 

apparatus. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS (Embodiment 1) 

[0029] Embodiment 1 of the stereoscopic image dis- 
play apparatus of the present invention will be described 
hereinafter with reference to Figs. 1 to 10. Fig. 1 is an 
appearance view of Embodiment 1 of the present inven- 
tion. 

[0030] In the same figure, numeral 100 denotes the 
main body indicating the whole of this apparatus. Nu- 
meral 110 represents an image display section (dis- 
play). 

[0031] Numeral 111 indicates a stereoscopic image 
display region (3D window) for displaying the stereo- 
scopic image (parallax image) in the image display sec- 
tion 110. 

[0032] Numeral 120 designates a pupil position de- 
tector (view-point position detector) for detecting the pu- 
pil positions of the observer's left and right eyes. Numer- 
al 121 denotes a photographing device (camera), which 
is a component of the pupil position detector 120. 
[0033] Fig. 2 is a system block diagram for explaining 
the system of Embodiment 1. In the same figure, the 
image display section (display) 110 has an image dis- 
play device (image display means) 210 comprised of a 
transmissive display device of liquid crystal or the like 
having the discrete pixel structure, an optical modulator 
240 comprised of a transmissive display device of liquid 



crystal or the like also having the discrete pixel structure, 
an optical means 250 comprised of a Fresnel lens or the 
like, a light source means 260 comprised of a plasma 
display or the like having the discrete pixel structure, and 
5 so on. 

[0034] The image display device 210 displays a ster- 
eoscopic image with parallax (parallax image) or an or- 
dinary two-dimensional image without parallax. A region 
for display of the parallax image corresponds to the ster- 
eo eoscopic image display region 111 of Fig. 1. 

[0035] The image display 210 is driven by an image 
display device drive circuit 272 and an image based on 
a signal from an image processing means 271 is dis- 
played on a display screen of the image display 210. 
is [0036] The image processing means 271 outputs the 
signal of the image to be displayed on the image display 
device 210, through the image display device drive cir- 
cuit 272 to the display, and also outputs the size of the 
stereoscopic image display region 111, the position in- 
20 formation thereof, and the synchronous signal of the dis- 
play image to a signal synthesizing circuit 273. 
[0037] The pupil position detector 120 outputs pupil 
position information of observers 281 , 282 observing the 
image display device 21 0, to the signal synthesizing cir- 
25 cuit 273. 

[0038] The signal synthesizing circuit 273 generates 
information for controlling the optical modulator 240 and 
the light source means 260, based on these information, 
and outputs the information to an optical modulator drive 

30 circuit 275 and to a light source means drive circuit 274. 
[0039] The optical modulator 240 is driven by the op- 
tical modulator drive circuit 275 to display the mask pat- 
tern of vertical slit shape, which will be described here- 
inafter, in the region corresponding to the stereoscopic 

35 image display region 111 of the image display device 
21 0 and display an image of uniform density in the two- 
dimensional image display region on the display screen 
thereof. 

[0040] On that occasion, the pattern shape of the 

to mask pattern, the display position of the pattern; and the 
size of the pattern are controlled, based on the size of 
the stereoscopic image display region 111 displayed on 
the image display device 210, the position information, 
and the observer's pupil position information from the 

45 pupil position detector 120. 

[0041] The light source means 260 is driven by the 
light source means drive circuit 274 and on that occa- 
sion, positions of paired on portions of the light source 
means 260 are controlled, based on the observer's pupil 

50 position information from the pupil position detector 1 20 . 
This permits each observer to observe the stereoscopic 
image at any location, as detailed hereinafter. 
[0042] Numerals 281 and 282 represent the observ- 
ers of the display and the present embodiment shows 

55 an example in which there are two observers. 

[0043] Fig. 3 is a schematic diagram to show the main 
part of the stereoscopic image display region 111. In Fig. 
3, 261 R, 261 L, and 262R, 262L in the light source 
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means 260 indicate on areas of the light source, and the 
other areas are in an off state. 

[0044] The optical means 250 of the Fresnel lens or 
the like acting as a convex lens (positive lens) is de- 
signed according to such optical specifications as to im- 
age the surface of the light source means 260 approxi- 
mately at the observer's position. 
[0045] The optical modulator 240 displays the mask 
pattern 241 acting as an optical barrier, on the display 
screen thereof. 

[0046] The image display device 210 displays a syn- 
thetic parallax image 211 . in which vertical stripes of the 
left and right images (parallax images) are arranged al- 
ternately at the pitch Hn. on the display screen thereof. 
[0047] It is noted that Fig. 3 is drawn with omitting 
glass covers, polarizers, electrodes, etc. of the image 
display device 210. the optical modulator 240, and the 
light source means 260. 

[0048] 281 EL, 281 ER and 282EL. 282ER represent 
the left eye and the right eye of the observers 281 , 282, 
respectively, observing the image display device 210. 
[0049] The on and off areas of the light source means 
260 will be described below referring to Fig. 4. 
[0050] In Fig. 4, images of the on areas 261 R, 261 L 
and 262R, 262L on the light source means 260 are fo- 
cused at the observation position of the observers to 
form areas 261 R\ 261 L' and 262R', 262LV 
[0051] On that occasion, the on areas 261 R. 261 Land 
262R ; 262L are controlled so that the left and right eyes 

281 EL, 281 ER and 282EL. 282ER of the observers 281 , 

282 correspond to the respective areas 261 L\ 261 R' 
and 262L\ 262RV 

[0052] The size of the on areas is set so that the size 
of the images thereof can cover each eye of the observ- 
ers, and the positions of the on areas are determined, 
based on the observer's pupil position information ob- 
tained from the pupil position detector 120 described 
previously. 

[0053] The mask pattern 241 displayed on the optical 
modulator 240 witl be described below referring to Fig. 

5. Fig. 5 is an enlarged front view of the mask pattern 
241 illustrated in Fig. 3. 

[0054] As illustrated in the same figure, the mask pat- 
tern 241 is composed of light-transmitting portions 242 
and shield portions 243 of the slit shape, arranged at the 
pitch Hm in the horizontal direction. 
[0055] In the present embodiment each transmitting 
portion 242 is composed of three pixels 244 to 246 and 
each shield portion 243 is also composed of three pixels. 
[0056] The parallax image displayed on the image 
display device 21 0 will be described next referring to Fig. 

6. In Fig. 6, the synthetic parallax imago G(1 , 2) is made 
by dividing two parallax images G(1 ), G(2) correspond- 
ing to the left and right eyes, into a lot of stripe images 
of the vertical stripe shape and arranging the stripe im- 
ages G(1 )i, G(2)i being elements of the parallax images 
G(1 ), G(2), on alternate pixels (alternate scan lines), as 
illustrated. 



[0057] This synthetic parallax image is displayed on 
the image display device 21 0 and on that occasion, the 
system is arranged to satisfy such relation between im- 
age and barrier in the known parallax barrier method 

5 that the horizontal width of a pair of two pixels of the left 
and right images displayed on the image display device 
21 0 corresponds to the horizontal pitch Hm of the mask 
pattern 241 of the optical modulator 240. 
[0058] The observer's pupil position detector 1 20 will 

w be described below referring to Figs. 7 to 9. 

[0059] Fig. 7 is an explanatory diagram to illustrate 
the pupil position detecting camera 121 constituting the 
pupil position detector 120 of this Embodiment 1. 
[0060] In the figure, numeral 122 indicates a visible 

*5 light camera having the sensitivity in the visible light re- 
gion, 123 an infrared light camera having the sensitivity 
in the infrared light region, 1 24 and 1 25 half mirrors, and 
126 an infrared light emitter having its spectral intensity 
in the infrared region, for example, at the wavelength 

20 850 nm, such as an infrared emitting LED or the like. 
[0061 ] These components are arranged, as illustrated 
in the figure, so that the two cameras 122, 123 are 
placed optically on the same axis and at equivalent dis- 
tances to the subject, their angles of view are set to an 

25 equal value, and the infrared light emitter 1 26 is located 
in the coaxial lighting layout with respect to the two cam- 
eras. 

[0062] Each of the visible light camera 122 and the 
infrared light camera 1 23 is composed of an image pick- 

30 up device 1221 , 1231 of CCD etc., an optical filter 1222, 
1232, and a taking lens 1223, 1233. 
[0063] The spectral transmittance characteristics of 
the optical filter 1 222 are set so that the visible light cam- 
era 122 has the sensitivity in the visible light region, in 

35 combination with the spectral sensitivity characteristics 
of the image pickup device 1221 . 
[0064] The spectral transmittance characteristics of 
the optical filter 1232 are set so that the infrared light 
camera 1 23 has the sensitivity in the region of the spec- 

40 tral characteristics of the infrared light emitter 126, in 
combination with the spectral sensitivity characteristics 
of the image pickup device 1231 . 
[0065] Numerals 1 224 and 1 234 indicate stops of the 
camera lenses 1223, 1233, respectively. 

45 [0066] The pupil position detecting camera 121 inthe 
above structure is positioned in the front lower part of 
the image display device 100 and the photographic 
range of the two cameras is set to cover the observer's 
face region. 

so [0067] Photographic screens of the observers 281, 
282 taken in this state are presented in Fig. 8 and Fig. 9, 
[0068] Fig. 8 is the photographic screen of the observ- 
ers taken by the visible light camera 122. Fig. 9 is the 
photographic screen by the infrared light camera 123. 

55 [0069] Since in the near infrared region the reflect- 
ance of the retina of the human eyes is higher than that 
of the face skin, pupil images of the observer's eyes are 
displayed as bright points, as illustrated in Fig. 9, on the 
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photographic screen of the infrared light camera by 
properly setting the emission intensity of the infrared 
light emitter 126 and the sensitivity of the infrared light 
camera 123. 

[0070] The pupil position information of the observer's 
left and right eyes is obtained from these pupil images 
by a known image processing method. 
[0071 ] By making use of the fact that the pupil-to-pupil 
distance E of the human eyes is near 63 mm, the pupil 
images of a plurality of observers are separated and 
identified in such a way that a pair of bright points apart 
at the pupil-to-pupil distance E are judged as the left and 
right eyes of one observer. 

[0072] The pupil positions of the observer's eyes are 
always detected by detecting the pupil positions from 
the screen of the infrared light camera 123 and tracking 
the vicinity of the eyes of face images by a known pattern 
matching method, based on the information of the pupil 
positions, with the visible light camera 122. 
[0073] The combination use of the image by the infra- 
red light camera 123 and the image by the visible light 
camera 122 permits the apparatus to dispose of disap- 
pearance of the bright points of the pupil images in the 
infrared camera image, which occurs when the observer 
blinks. 

[0074] The optical action of the stereoscopic image 
display will be described below referring to Fig. 10. Fig. 
10 is a horizontal cross-sectional view (X-Z section) of 
the 3D window region 111 of Fig. 3. 
[0075] In the same figure, light from the on areas 
261 L, 261 R of the light source means 260 travels 
through the optical means 250 to illuminate the optical 
modulator 240. 

[0076] Light passing through the pixels 244 to 246 of 
the transmitting portions 242 in the optical modulator 
240 is projected to areas SL1 , SR1 at the observation 
position. 

[0077] On that occasion, the beams projected to the 
illumination areas SL1 , SR1 are modulated by the syn- 
thetic parallax image displayed on the display device 
210 provided between the optical modulator 240 and the 
observer. 

[0078] Since the transmitting portions 242 and the 
shield portions 243 displayed on the optical modulator 
240, and the left and right parallax images in the form 
of vertical stripes displayed on the image display device 
210 have the relation of the parallax barrier method as 
described previously, the area SL1 is illuminated with 
beams having passed, for example, through the ele- 
ment stripe images G(1)1, G(1)3, G(1)5,... of the paral- 
lax image G(1) forming the synthetic parallax image G 
(1, 2) illustrated in Fig. 5. 

[0079] However, since the on area 261 L is imaged in 
an area 261 L' at the observation position because of the 
action of the optical means 250, the observable region 
of the parallax image G1 is limited to the vicinity of the 
area 261 L' and it is not obs rved from the other posi- 
tions, for example, from the areas 281 ER, 282EL, and 



282ER. 

[0080] On the other hand, the area SR1 is illuminated 
with beams having passed through the element stripe 
images G(2)2, G(2)4, G(2)6,... of the parallax image G 
5 (2) constituting the synthetic parallax image G(1 , 2) il- 
lustrated in Fig. 5. 

[0081] However, since the on area 261 R is imaged in 
an area 261 R' at the observation position because of 
the action of the optical means 250, the observable re- 
gion of the parallax image G2 is limited to the vicinity of 
the area 261 R' and it is not observed from the other po- 
sitions, for example, from the areas 281 EL, 282EL : and 
282ER. 

[0082] Therefore, when the parallax images corre- 
sponding to the two eyes are selected as the parallax 
images G(1), G(2) and when the eyes 281 EL, 281 ER 
are placed in the illuminated parallax image areas 261 L', 

261 R\ the observer observes the parallax images sep- 
arately and independently by the left and right eyes, so 
as to be able to observe the stereoscopic image. 
[0083] The above description was made for the ob- 
server 261 , but the same can also apply to the observer 
262; the observer 262 can observe the stereoscopic im- 
ago, independent of the relative position of the observer 

262 to the observer 261 , by properly displaying the par- 
allax image on the display device 21 0 and the mask pat- 
tern 241 on the optical modulator 240 in the same man- 
ner as above. 

[0084] When states corresponding to these observers 
261 , 262 are displayed alternately in time-sharing man- 
ner and within the time of action of the after image effect 
of the eyes, the two observers can observe the stereo- 
scopic image on the same image display 210. 
[0085] If the observers 261 , 262 move : the positions 
of the light projection areas of the optical modulator 240 
and the positions of the on areas of the light source 
means 260 will be moved in pixel units, based on the 
information of the pupil position detector 1 20, so that the 
illuminated parallax image areas follow the observer's 
pupil positions, thereby enabling stable observation of 
the stereoscopic image. 

[0086] The above description was made for the case 
of two observers, but the same also applies to the cases 
of three or more observers; each observer can observe 
the stereoscopic image in time-sharing manner by con- 
trolling the emission areas of the light source means 260 
to positions corresponding to the observer (e.g., by con- 
trolling positions of three pairs of emission portions in 
the case of three observers) and properly controlling the 
mask pattern 241 of the optical modulator 240. 
[0087] In the present embodiment the independent 
emission areas are set respectively for the left and right 
eyes of each observer, but one emission area may be 
set so as to include the areas corresponding to the left 
and right eyes. In this case, n emission areas are set for 
n observers. 

[0088] The optical means 250 can be an optical mem- 
ber having the power only in the horizontal direction (X- 
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direction) and the emission areas are formed in the ver- 
tical stripe shape. This can increase the utilization effi- 
ciency of the light source. 

[0089] Further, the present embodiment employs the 
surface light emitting device having the size approxi- 5 
mately equal to that of the image display device, as the 
light emitting means and uses parts thereof to emit light, 
but the light emitting means may be a light emitting de- 
vice having the emission part of a fixed area and me- 
chanically moved according to the observer's position. w 
[0090] In addition, the present embodiment permits a 
lot of observers to observe the stereoscopic image si- 
multaneously on a single image display device, by de- 
tecting the pupil positions of the observers and present- 
ing the parallax images corresponding to the left and is 
right eyes on the image display device. (Embodiment 2) 
[0091] Embodiment 2 of the stereoscopic image dis- 
play apparatus of the present invention will be described 
hereinafter with reference to Figs. 11 lo 19. The mem- 
bers having the same action as in Embodiment 1 will be 20 
denoted by the same reference numerals and will be de- 
scribed mainly in comparison with Embodiment 1 . 
[0092] The overall diagram of this Embodiment 2 is 
similar to Fig. 1 showing the whole of Embodiment 1. 
Fig. 11 is a system block diagram for explaining the sys- 25 
tern of Embodiment 2. 

[0093] In Fig. 11, the image display section 110 is 
comprised of a transmissive image display device 210 
of liquid crystal orthe like having the discrete pixel struc- 
ture, a transmissive optical modulator 240 of liquid crys- 30 
tal or the like also having the discrete pixel structure, an 
optical means 250 of a Fresnel lens or the like, a light 
source means 260 of a plasma display or the like having 
the discrete pixel structure, and two lenticular lenses 
220, 230 the directions of generating lines of which are 35 
perpendicular to each other and which are disposed be- 
tween the image display device 210 and the optical 
modulator 240. 

[0094] For convenience' sake of description hereinaf- 
ter, a unit consisting of the image display 210, optical 40 
modulator 240, and two lenticular lenses 220, 230 is de- 
noted by 200. 

[0095] The image display device 210 displays the 
stereoscopic image with parallax (parallax image) orthe 
ordinary two-dimensional image without parallax. The 45 
region for display of the parallax image corresponds to 
the stereoscopic image display region 111 of Fig. 1. 
[0096] The image display device 21 0 is driven by the 
image display device drive circuit 272 and an image 
based on a signal from the image processing means 271 50 
is displayed on the display screen thereof. 
[0097] The image processing moans 271 outputs the 
signal of the image to be displayed on the image display 
device 210. through the image display device drive cir- 
cuit 272 to the display, and also outputs the size of the 55 
stereoscopic image display region 111 , the position in- 
formation thereof, and the synchronous signal of image 
to the signal synthesizing circuit 273. 



[0098] The pupil position detector 1 20 outputs the pu- 
pil position information of the observer's eyes to the sig- 
nal synthesizing circuit 273, 

[0099] The signal synthesizing circuit 273 generates 
the information for controlling the optical modulator 240 
and the light source means 260, based on these infor- 
mation, and outputs the information to the optical mod- 
ulator drive circuit 275 and to the light source means 
drive circuit 274. 

[0100] The optical modulator 240 is driven by the op- 
tical modulator drive circuit 275 to display a checkered 
mask pattern, described hereinafter, in the region cor- 
responding to the stereoscopic image display region 1 1 1 
of the image display device 21 0 and also present a dis- 
play of uniform density in the two-dimensional image 
display area on the display screen thereof. 
[0101] On that occasion, the pattern shape of the 
mask pattern of the optical modulator 240, the display 
position of the pattern, and the size of the pattern are 
controlled based on the size of the stereoscopic image 
display region 111 displayed on the image display de- 
vice 210 described previously, the position information 
thereof, and the observer's pupil position information 
from the pupil position detector 120. 
[0102] The light source means 260 is driven by the 
light source means drive circuit 274 and on that occa- 
sion, the positions of the on areas of the light source 
means 260 are controlled based on the observer's pupil 
position information from the pupil position detector 1 20. 
[0103] Numerals 281 and 282 represent observers of 
the display 210, and the present embodiment is an ex- 
ample of two observers. 

[0104] Fig. 12 is a schematic diagram to show the 
main part of the stereoscopic image display region 111 . 
In Fig . 1 2, numeral 260 indicates the light source means, 
and 261 R, 26 1L and 262R, 262L indicate on areas of 
the light source. The other areas of the light source are 
in the off state. 

[0105] Numeral 250 denotes the optical means acting 
as a convex lens, such as the Fresnel lens or the like, 
which is designed according to such optical specifica- 
tions as to image the surface of the light source means 
260 approximately at the observer's position, 
[0106] Numeral 240 designates the optical modulator, 
and the mask pattern 241 acting as an optical barrier is 
formed in the display screen thereof, 
[0107] Numeral 230 represents a horizontal lenticular 
lens (horizontal cylindrical lens array) having the gener- 
ating line in the horizontal direction (X-direction), which 
is composed of an array of many horizontal cylindrical 
lenses of the planoconvex shape arranged in the vertical 
direction (Y-direction). 

[0108] The horizontal lenticular lens 230 is designed 
to have such lens curvature that the mask pattern 241 
is imaged on the image display screen of the image dis- 
play 210. 

[0109] The lens pitch (width) V1 of the horizontal len- 
ticular lens 230 is designed so as to correspond to the 
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vertical width Vm of the transmitting portions and the 
Shield portions of the mask pattern 241 . 
[0110] Numeral 220 designates a vertical lenticular 
lens (vertical cylindrical lens array) having the generat- 
ing line in the vertical direction, which is composed of 
an array of many vertical cylindrical lenses of the plano- 
convex shape arranged in the horizontal direction. 
[0111] Each cylindrical lens forming the vertical len- 
ticular lens 220 is designed to have such lens curvature 
that the mask pattern 241 is imaged at the observation 
position. 

[0112] One pitch (width) H1 of the vertical cylindrical 
lenses of the vertical lenticular lens 220 corresponds to 
the horizontal pitch width Hm of the transmitting portions 
and the shield portions of the mask pattern 241 . 
[0113] The image display device 210 displays the 
synthetic parallax image 211 synthesized from two par- 
allax images. 

[0114] The image magnification of the horizontal len- 
ticular lens 230 is set so that the vertical width Pv of 
displayed pixels of the synthetic parallax image 21 1 cor- 
responds to the vertical width Vm of the transmitting por- 
tions and shield portions of the mask pattern 241 . 
[0115] Just as in the case of Embodiment 1, Fig. 12 
is drawn with omitting the glass covers, polarizers, elec- 
trodes, etc. of the image display device 210, the optical 
modulator 240, and the light source means 260. 
[0116] 281 EL, 281 ER and 282EL, 282ER represent 
the left and right eyes of the image observers 281 1 282, 
respectively. 

[01 1 7] The on and off areas of the light source means 
260 will be described below referring to Fig. 13. In Fig. 
13, the on areas 261 R. 261 L and 262R ; 262L on the 
light source means 260 are imaged at the observation 
position of the observers by the optical means 250 to 
form the areas 261 R\ 261 L' and 262R\ 262L'. 
[01 18] On that occasion , the on areas 261 R. 261 L and 
262R, 262L are controlled so that the left and right eyes 

281 EL, 281 ER and 282EL, 282ER of the observes 281 , 

282 correspond to the respective areas 261 L', 261 R' 
and 262L', 262R'. 

[01 1 9] The size of the on areas is designed to be such 
size that the size of the images thereof can cover each 
eye of the observers, and the positions of the on areas 
are determined based on the observer's pupil position 
information obtained by the view-point position detector 
120 described previously. 

[0120] The mask pattern 241 displayed on the optical 
modulator 240 will be described next referring to Fig. 14. 
Fig. 1 4 is an enlarged front view of the mask pattern 241 
illustrated in Fig. 11 . 

[0121] As illustrated in the same figure, the mask pat- 
tern 241 is a checkered pattern consisting of the trans- 
mitting portions 242 and the shield portions 243 having 
the horizontal pitch Hm and the vertical width Vm. 
[0122] In the present embodiment each transmitting 
portion 242 is composed of five pixels 244 to 248 and 
each shield portion 243 is also composed of five pixels. 



[0123] The parallax image displayed on the display 
device 210 will be described next referring to Fig. 15. 
[0124] In Fig. 15, each of the two parallax images G 
(1), G(2) corresponding to the left and right eyes is di- 

5 vided into a lot of stripe images of the horizontal stripe 
shape as illustrated, and the stripe images G(1)i, G(2)i 
being elements of the parallax images G(1), G(2) are 
arranged on alternate scan lines to obtain the synthetic 
parallax image G(1 , 2). 

10 [0125] The pupil position detector 120 is one similar 
to that in Embodiment 1 . 

[0126] The optical action of stereoscopic image dis- 
play will be described below referring to Fig. 16 to Fig. 
1 9. Fig. 1 6 is a horizontal cross-sectional view (X-Z sec- 
'5 tion) of the 3D window region 111 . 

[0127] In the same figure, light from an on area of the 
light source means 260, for example, from 261 R travels 
through the optical means 250 to illuminate the optical 
modulator 240. 
20 [0128] Light having passed through the pixels 244 to 
248 of the transmitting portions 242 of the optical mod- 
ulator is projected into the area SR1 at the observation 
position because of the action of the vertical lenticular 
lens 220. (The horizontal lenticular lens 230 has no spe- 
25 cific action in this sectional direction.) 

[0129] The beams projected into this illuminated area 
SR1 are modulated by the synthetic parallax image dis- 
played on the display device 210 provided between the 
vertical lenticular lens 220 and the observer. In this cross 
30 section, since the beams travel, for example, through 
the element stripe images G(1)1, G(1)3, G(1)5,... of the 
parallax image G(1) forming the synthetic parallax im- 
age G(1, 2) illustrated in Fig. 15, the illuminated area 
SR1 is an area to which the parallax image G1 is pro- 
35 jected. 

[0130] However, since the on area 261 R is imaged 
approximately in the area 261 R' at the observation po- 
sition because of the action of the optical means 250, 
the observable area of the parallax image G1 is limited 
40 to the vicinity of the area 261 R' and it is not observed 
from the other positions, for example, from the eyes of 
281 EL, 282ER, and 282EL. 

[0131] The area SR1 is composed of areas 244' to 
248' corresponding to the pixels 244 to 248. 

45 [0132] Likewise, as illustrated in Fig. 17, the light from 
the on area 261 L travels through the optical means 250 
to illuminate the optical modulator 240 in a cross section 
corresponding to a scan line one below or above the 
scan line of Fig. 16, 

so [0133] The light having passed through the transmit- 
ting portions 242 of the optical modulator is projected 
into the area SL2 at the observation position because 
of the action of the vertical lenticular lens 220. (The hor- 
izontal lenticular lens 230 has no specific action in this 

55 sectional direction.) 

[0134] The beams projected into this illuminated area 
SL2 are modulated by the synthetic parallax image dis- 
played on the display device 210 provided between the 
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vertical lenticular lens 220 and the observer. 
[01 35] In this cross section, since the light travels, for 
example, through the element stripe images G(2)2, G 
(2)4, G(2)6.... of the parallax image G(2) forming the 
synthetic parallax image G(1, 2) illustrated in Fig. 15, 
the illuminated area GS2 is an area to which the parallax 
image G2 is projected. 

[0136] However, since the on area 261 L is imaged in 
the area 261 L' at the observation position because of 
the action of the optical means 250, the observable area 
of the parallax image G2 is limited to the vicinity of the 
area 261 L' and it is not observed from the other posi- 
tions ; for example, from the eyes of 281 ER, 282ER, and 
282EL. 

[0137] Fig. 18 is a vertical cross-sectional view (Y-Z 
section) of the window for stereoscopic image display. 
In this cross section, the light from an on area of the light 
source means 260, for example, from 261 R travels 
through the optical means 250 to illuminate the optical 
modulator 240. 

[0138] An image of the transmitting portions 242 of the 
mask pattern 241 in the optical modulator 240 is formed 
on the image display screen of the display device 210 
because of the action of the horizontal lenticular lens 
230 and on that occasion, the image is formed at such 
a magnification that the width of the transmitting portions 
242 of the optical modulator 240 becomes the pixel 
width of the display device 210. 

[0139] Therefore, only the element stripe images of 
the parallax image, for example, of G(1 ), are projected 
into the area by properly setting the positions of the op- 
tical modulator 240, the display device 210, and the hor- 
izontal lenticular lens 230. 

[0140] Further since the on area 261 R is imaged in 
the area 261 R* at the observation position because of 
the action of the optical means 250, the parallax image 
of G(1 ) can be observed only in the vicinity of the area 
261 R 1 . 

[0141] Likewise, as illustrated in Fig. 19, only the el- 
ement stripe images of the parallax image G(2) are pro- 
jected into a pixel column one pixel horizontally next to 
that of Fig. 15. 

[0142] Although not illustrated, the same can also ap- 
ply to the light emission area 261 L. Therefore, when the 
eyes 281 EL, 281 ER are placed in the projected parallax 
image areas 261 L", 261 R', respectively, the observer 
can observe the stereoscopic image while observing the 
parallax images separately and independently by the 
left and right eyes. 

[01 43] The above description was given as to the ob- 
server 281 , and the same also applies to the observer 
282; the observer 282 can observe the stereoscopic im- 
age by properly setting the parallax image on the display 
device 210 and the mask pattern 241 on the optical mod- 
ulator 240. 

[01 44] When the two states described above are dis- 
played alternately in time-sharing manner and within the 
time of the after image effect of the eyes, the two ob- 



servers can observe the stereoscopic image simultane- 
ously in the single image display. 
[0145] If the observers 281 , 282 move ! the positions 
of the projection areas of the optical modulator 240 and 

5 the positions of the on areas of the light source means 
260 will be moved in pixel units, based on the informa- 
tion of the pupil position detector, so that the projected 
parallax image areas follow the observer's pupil posi- 
tions, thereby enabling stable observation of stereo- 

10 scopic image. 

[0146] The above description was made about the 
case of the two observers, but the present embodiment 
can also be applied similarly to the cases of three or 
more observers; each observer can observe the stere- 

15 oscopic image in time-sharing manner by controlling the 
emission areas of the light source means 260 to the po- 
sitions according to the respective observers and prop- 
erly controlling the mask pattern 241 of the optical mod- 
ulator 240. In addition, the independent emission areas 

20 were set for the respective left and right eyes of each 
observer in the present embodiment, but each emission 
area can be set as an area including the areas corre- 
sponding to the left and right eyes. The utilization effi- 
ciency of the light source may also be increased by us- 

25 ing the optical member having the power only in the hor- 
izontal direction (X-direction), as the optical means 260 
to form the emission areas in the vertical stripe shape. 
Further, the present embodiment employed the surface 
light emitting device having the size approximately 

30 equal to that of the image display device, as the light 
emitting means and used portions thereof for emission 
of light, but the light emitting means can be a light emit- 
ting device having a light emitting portion of a fixed area 
and mechanically moved according to the position of the 

35 observer. These can also be applied similarly to Embod- 
iment 2, as in Embodiment 1. 

[0147] The present invention can accomplish the ster- 
eoscopic image display apparatus that permits the ob- 
servation of stereoscopic image with good image qual- 
40 ity. 

[0148] In addition, the present invention can accom- 
plish the stereoscopic image display apparatus that per- 
mits a plurality of observers to observe the stereoscopic 
image simultaneously with good image quality. 

45 [0149] A stereoscopic image display apparatus is 
constructed to guide a parallax image displayed on a 
display, to the left eye and to the right eye of an observer, 
thereby permitting the observer to stereoscopically ob- 
serve the image information displayed on the display. 

50 The stereoscopic image display apparatus has a view- 
point position detecting device for detecting positions of 
view points of the observer, an image display device for 
displaying the parallax image, a light source device in 
which a position of each light emitting portion is control- 

55 led based on information from the view-point position 
detecting device, an optical system for imaging each 
light emitting portion of the light source device at or near 
an observation position, and a separating device for 
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separating light from the tight source device to guide 
separated beams to the two eyes of the observer. 



Claims 

1 . A stereoscopic image display apparatus comprising 
light source means in which positions of a plurality 
of light emitting portions are controllable; image dis- 
play means which displays a stripe image obtained 
by dividing parallax images into a lot of stripe pixels 
and. arranging the stripe pixels in a predetermined 
order to form one image; separating means which 
converts beams from the light source means into 
beams with directivity and which separates beams 
from the image display means into beams toward a 
plurality of areas and guides the separated beams 
to an observer so as to permit the observer to vis- 
ually recognize the stripe image as a stereoscopic 
image; optical means for forming an image of each 
light emitting portion of the light source means at or 
near an observation position through the separating 
means and the image display means; and view- 
point position detecting means for detecting posi- 
tions of view points of the observer, wherein said 
light source means controls the number and posi- 
tions of light emitting portions, based on a signal 
from the view-point position detecting means. 

2. The stereoscopic image display apparatus of Claim 

1 wherein said separating means is comprised of 
an optical modulator having a discrete pixel struc- 
ture, or comprised of an optical modulator having a 
discrete pixel structure and an optical system. 

3. The stereoscopic image display apparatus of Claim 

2 wherein said optical system comprises a vertical 
cylindrical lens array consisting of vertical cylindri- 
cal lenses having a generating line in the vertical 
direction and a horizontal cylindrical lens array con- 
sisting of horizontal cylindrical lenses having a gen- 
erating line in the horizontal direction. 

4. The stereoscopic image display apparatus of Claim 
1 wherein said view-point position detecting means 
comprises infrared light emitting means and detects 
positions of pupils of the eyes of the observer. 

5. The stereoscopic image display apparatus of Claim 
1 wherein said image display means is comprised 
of a transmissive image display device having a dis- 
crete pixel structure. 

6. The stereoscopic image display apparatus of Claim 
1 wherein said light source means is a surface emis- 
sion type light source having a discrete pixel struc- 
ture. 



7. The stereoscopic image display apparatus of Claim 
1 wherein said optical means is a Fresnel lens act- 
ing as a convex lens, or a Fresnel lens acting as a 
convex lens only in the horizontal direction. 

5 

8. The stereoscopic image display apparatus of Claim 
1 wherein said view-point position detecting means 
detects positions of view points of a plurality of ob- 
servers independently of each other and wherein 

10 said light source means controls positions of light 
emitting portions corresponding to the respective 
observers, based on the signal from the view-point 
position detecting means. 

'5 9. a stereoscopic image display apparatus in which 
beams from light source means in which a position 
of a light emitting portion is controllable, are con- 
verted into beams with directivity by separating 
means to illuminate a parallax image on image dis- 

20 play means displaying stripes of parallax images 
whereupon beams based on the respective parallax 
images are guided separately to the right eye and 
to the left eye of an observer, thereby permitting the 
observer to observe a stereoscopic image, wherein 

25 an image of the light emitting portion of the light 
source means is formed at or near an observation 
position through the separating means and the im- 
age display means by optica means and wherein 
the position of the light emitting portion of the light 

30 source means is controlled, based on a signal from 
view-point position detecting means for detecting 
positions of view points of the observer. 

10. The stereoscopic image display apparatus of Claim 
35 9 wherein said separating means is comprised of 
an optical modulator having a discrete pixel struc- 
ture or comprised of an optical modulator having a 
discrete pixel structure and an optical system. 

40 11. The stereoscopic image display apparatus of Claim 
1 0 wherein said optical system comprises a vertical 
cylindrical lens array consisting of vertical cylindri- 
cal lenses having a generating line in the vertical 
direction and a horizontal cylindrical lens array con- 

^5 sisting of horizontal cylindrical lenses having a gen- 
erating line in the horizontal direction. 

12. The stereoscopic image display apparatus of Claim 
9 wherein said view-point position detecting means 

so comprises infrared light emitting means and detects 
positions of pupils of the eyes of the observer. 

13. The stereoscopic image display apparatus of Claim 
9 wherein said image display means is comprised 

55 of a transmissive image display device having a dis- 
crete pixel structure. 

1 4. The stereoscopic image display apparatus of Claim 
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9 wherein said light source means is a surface emis- 
sion type tight source having a discrete pixel struc- 
ture. 

15. The stereoscopic image display apparatus of Claim 5 
9 wherein said optical means is a Fresnel lens act- 
ing as a convex lens, or a Fresnel lens acting as a 
convex lens only in the horizontal direction. 

1 6. A stereoscopic image display apparatus comprising io 
fight source means in which positions of light emit- 
ting portions in a number according to the number 

of observers are controllable; image display means 
which displays a stripe image obtained by dividing 
a parallax image for the right eye and a parallax im- is 
age for the left eye each into a lot of stripe pixels 
and alternately arranging the right stripe pixels and 
left stripe pixels thus obtained, in a predetermined 
order to form one image; separating means which 
converts beams from the light source means into 20 
beams with directivity by a lenticular lens array and 
which separates beams from the image display 
means into beams toward a plurality of areas and 
guides the beams to each observer to permit the 
observer to visually recognize the stripe image as 25 
a stereoscopic image; imaging means for imaging 
each light emitting portion of the light source means 
at or near an observation position through the sep- 
arating means and the image display means; and 
view-point position detecting means for detecting 30 
positions of view points of each observer wherein 
said light source means controls the number and 
positions of light emitting portions, based on a sig- 
nal from the view-point position detecting means. 
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